Imagine you lived on an Earth where orbital rings and towers give access to space, the outer planets have been transformed into supramundane worlds, and the Sun is encompassed by a Dyson Swarm. What would the night sky look like?
For megastructures and artificial habitats, just imagine seeing the ISS as it is now orbiting overhead, but multiplied across the entire sky and in many different shapes and apparent magnitudes. Orbital rings and space-elevator structures would resemble bright, shining beams of light arcing across the sky. Mega-planets would probably look like any other planet visible to the naked eye, unless their overall size was significantly increased. If the latter is true, then perhaps you could make out some details on their surfaces if their albedo is not so high. This is all assuming that the engineers do not make efforts to reduce the reflectivity of these structures, perhaps even to the point where some are invisible to the naked eye (i.e. a perfect blackbody object).
Orbital/Lagrange/Statite mirrors will probably reflect sunlight in many interesting ways, including onto the nightside of a planet if required, or on specific objects in space. It is unlikely that the sun itself would dim much from a vantage on Earth when it is surrounded by a Dyson Swarm - unless the Swarm is REALLY thick or some crazy megastructure is orbiting the star and has enough surface area to significantly cover a portion of Sol's face. Our sun certainly will be dimmer (or even invisible) in certain wavelengths at this time though, as some forms of light the mega-engineerers might find useful for any number of technological tasks like photosynthesis or solarcells.
Given the reflecting surface area of an orbital ring, it would seem to me that it would be like a permanent full moon on Earth's night time surface.
Jupiter has an albedo of 52 percent, while Earth's is 30. If you built a shell around it with atmosphere, land masses, oceans and enough focused sunlight to approximate Earth, it would be something like three times brighter and it's already a tremendously bright object.
If you built your Dyson Swarm inside Earth's orbit, how would you keep it from shading out Earth? If you built it outside, wouldn't it blot out most of the stars?
This really depends on the reflectivity of the material these structures are made of. If they are manufactured from a material with very low albedo OR were coated in a highly absorptive layer (which would be the case if they were solar-cells), then absolute magnitude could be significantly reduced.
In plain terms, if there is a relatively low density of objects orbiting the Sun, then our star's overall luminosity will outshine the shading of those disruptive objects, rendering them invisible against the glare of Sol. As more and more objects are placed in orbit between the Sun and an observer, then certain wavelengths will be cut into until there are so many orbiting objects that the Sun disappears. I won't do the math here, but it would take many millions of sizable objects orbiting our star to completely dim it from an Earth perspective. Furthermore, I wouldn't worry about the Earth being completely shrouded in darkness from spatial infrastructure, because orbital mirrors reflecting light where it is needed would be a ready solution.
A similar scenario would play out here. Depending on the distance of the objects from Earth, even objects that are many hundreds or thousands of km in size would disappear among a backdrop of stars, at a rate inverse to their proportional distance from Earth and Sol. Most would be invisible but for their reflective surfaces, if they have any. These farther objects would form many new artificial constellations, and I'm sure amateur astronomers would love seeking out and observing these new nightsky objects.
It would need to be a very thick Dyson Swarm indeed to block out all starlight. Artificial structures that orbit closer then Mars I could see as posing a more immediate concern to our nightsky visibility, but perhaps clever use of orbital mirrors or artificial-skies projected by satellites can remedy that. By the time such megastructures reach this level of pervasiveness in our solar-system, Earth itself may be a Shell-world of some sort, so the ceiling of each layer where people live could support a fully accurate artificial sky.